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ABSTRACT 

This study was designed to assess the effect the 
summer vacation period has on the reading ability of first-grade 
subjects, as measured by norm- and criterion-referenced reading 
tests. The data were analyzed to determine if sex of subject, IQ, or 
type of school reading curriculum were related to the ability to 
retain overall reading ability or specific reading skills. Subjects 
in the study were 311 first-grade pupils enrolled in nine 
northeastern Wisconsin elementary schools. Approximately one-half of 
the subjects were enrolled in an objective-based reading program 
while the remaining subjects were enrolled in basal reader curricula. 
It was concluded that sex of subject, intellectual ability, and type 
of school reading curriculum do not appear to be important variables 
related to the retention of overall reading ability and specific 
reading skills. While significant losses were found on 11 of the 14 
measures, when the data were examined in terms of percentage of 
subjects considered to have mastered the skills in the spring and 
fall, only 15 percent of the subjects needed to be recategorized. 
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STATEMENT OF FOCUS 



Individually Guided Education (IGE) is a new comprehensive system 
of elementary education. The following components of the IGE system 
are in varying stages of development and implementation: a new 
organization for instruction and related administrative arrangements; 
a model of instructional programing for the individual student; and 
curriculum components in prereading, reading, mathematics, motivation, 
and environmental education. The development of other curriculum 
components, of a system for managing instruction by computejr, and of 
instructional strategies is needed to complete the system. Continuing 
programmatic research is required to provide a sound knowledge base for 
the components under development and for improved second generation 
components. Finally, systematic implementation is essential so that 
the products will function properly in the IGE schools. . 

The Center plans and carries out the research, development, and 
Implementation components of its IGE program in this sequence: 

(1) identify the needs and delimit the component problem area; 

(2) assess the possible constraints— financial resources and availability 
of staff; (3) formulate general plans and specific procedures for 
solving the problems; (4) secure and allocate human and material 
resources to carry out the plans; (5) provide for effective communication 
among personnel and efficienf management of activities and resources; 

and (6) evaluate the effectiveness of each activity and its contri- 
bution to the total program and correct any difficulties through 
feedback mechanisms and appropriate management techniques. 

A self-renewing system of elementary education is projected in 
each participating elementary school, i.e., one which is less dependent 
on external sources for direction and Is more responsive to the needs 
of the children attending each particular school. In the IGE schools, 
Center-developed and other curriculum products compatible with the 
Center s instructional programing model will lead to higher morale 
and job satisfaction among educational personnel. Each developmental 
product makes Its unique contribution to IGE as It is implemented in 
the schools. The various research components add to the knowledge of 
Center practitioners, developers, and theorists. 
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AB TRACT 



This study was designed to assess the effect the summer vacation 
period has on the reading ability of first-grade subjects, as measured 
by norm- and criterion-referenced reading tests. The data were analyzed 
to determine If sex of subject, IQ, or type of school reading curriculum 
were related to the ability to retain overall reading ability or specific 
reading skills. 

Subjects in the study were 311 first-grade pupils enrolled in 
nine northeastern Wisconsin elementary schools. Approximately one-half 
of the subjects were enrolled in an objective-based reading program 
while the remaining subjects v/ere enrolled in basal reader curricula. 

All subjects were administered the Gates-MacGlnltle Reading Test . 
Primary A, and the Wisconsin Tests of Reading Skill Development-Word 
Attack, Level B, two weeks prior to and two weeks after the summer vaca- 
tion period. In addition, the California Short-Form Te st of Mental 
Maturity was administered to all subjects during the spring testing ses- 
sions. Subjects with IQ scores which fell within the third or seventh 
stanlnes were not Included in the data analysis. A multiple analysis 
of variance statistical treatment was used to analyze the data. Reten- 
tion of reading scores between the spring and fall was tha dependent 
variable; sex of subject, Intelligence, and type of school reading 
curriculum were the Independent variables. 

•> 
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Statistically significant differences were found between the mean 
spring and fall test scores on eleven of the fourteen measures. Sex of 
subject and type of school reading curriculum were not significantly 
r^.lated to ability to retain reading skills. Intelligence of subjects 
was found to be related to retention ability on only two of the measures. 

Fifteen percent of the subjects changed from being considered 
"masters" of the specific reading skills in the spring to being classi- 
fied as "nonmasters" in the fall. Achieving a score of eighty percent 
or better on any of the specific skill tests was the criterion for mas- 
tery. 

It was concluded that even though statistically significant los- 
ses occurred on most of the tests, the most meaningful measure of change 
was the difference between the percentage of subjects considered to have 
mastered the skills in the spring versus the percentage in the fall. 
The fifteen percent change between the two times was not considered 
great enough to suggest massive schoolwlde retesting of all subjects 
in criterion-referenced reading programs. Instead, retesting of sub- 
jects might be done on the basis of teacher subjective judgment, thereby 
reducing considerably, the cost and time necessary to implement such a 
reading program. 

In conclusion, then, sex of subject. Intellectual ability, and 
type of school reading curriculum do not appear to be important vari- 
ables related to the retention of overall reading ability and specific 
reading skills. While significant losses were found on eleven of the 
fourteen measures, when the drita were examined in terms of percentage 
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of subjects considered to hav- mastered the skills In the spring and 
fall, only fifteen percent of the subjects needed to be recategorlzed. 
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CHAPTER I 



INTRODUCTION 

The purpose of this study was to determine the degree to which 
first-grade subjects retain their reading ability over the summer 
vacation period. This Investigation examined two aspects of reading 
ability? overall reading ability as measured by a norm-referenced 
reading test, and specific reading skills as measured by criterion- 
referenced reading tests. In addition, the data were examined to deter- 
mine if there were significant retention rate differences between males 
and females, between above-average, average, and below-average mental 
ability subjects, and between subjects enrolled in an objective-based 
reading program versus those in traditional basal reader programs. 

Review of the Literature 

The ability to retain Information has long Interested psycholo- 
gists and educators. Retention of school subject matter over extended 
periods of time has received little emphasis during the past decade, 
however. Most investigations measuring retention ability of school 
subject matter were conducted before the 1950's. One of the earliest 
attempts to-Ifieasure retention ability, for example, was the study done 
by Irmlna (1928). She examined retention ability of first through 
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seventh grade subjects using eleven different measures. Intelligence, 
as well as reading, mathematics, and spelling ability, was measured. 
Tests were administered to her subjects the last week of school in the 
spring and within fourteen days after they returned to school in the 
fall. She concluded that the word recognition ability of first and 
second graders was not seriously affected by the vacation period. Thft 
Word Reading, Phrase Reading, and Sentence Reading subtest scores loss 
of first grade subjects was significant, but for second grade subjects 
the loss was only slight in two of the three schools studied and a gain 
was reported in the third school. On the Reading of Directions subtest 
of the Gates Primary Reading Test e, a consistent loss was found in grade 
one. In grade two, however, the subjects in two of the schools reported a 
slight gain. Subjects in all three schools indicated a gain in reading 
ability at the second grade level as measured by the Stanford Primary 
Reading Examination. Paragraph Reading subtest. Irmina (1928) cau- 
tioned, however, that the scores from only one school represented 
what could, "... be considered a real gain [p. 29]." There were 
no significant changes in scores for second graders on the Sentence 
Meaning subtest of the Stanford. And, subjects In only one school 
lost in ability on the Word Meaning subtest. She concluded that, 
"... there no longer appears to be any actual loss in reading 
ability due to a non-school period [p. 30]." 

Brueckner and Dlstad (1924) examined the reading retention 
ability of students In twelve first-grade classrooms. Using the 
Minneapolis Primary Reading Tesf and the Haggerty Reading Examination . 
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Sigma I, they found that median scores for each grade were lower in 
September than they were In June on the former test, but on the 
Haggerty Reading Examination there was no difference [p. 701]. Using 
the Haggerty Reading Examination . Sigma I, In another study, Morrison 
(1924) found that the median scores of first grade subjects actually 
Increased over the summer. This finding must be Interpreted with cau- 
tion, however, since his first grade sample Included only forty-five 
subjects, all from the same school. When scores from subjects In 
grades one, two, and three were examined together, seventy percent of 
the subjects Improved whl]e thirty percent lost. He concluded, how- 
ever, that there was, "... practically no change in their reading 
ability [p. 249]." 

A larger number of studies has been conducted with older subjects. 
In an effort to determine what effect the summer vacation period has 
on Intermediate grade subjects' reading ability (grades 3-6), Elder 
(1923) tested 203 subjects In May and September with the Monroe 
Standardized Silent Reading Test . When the data were analyzed without 
reference to grade. It was discovered that 59 percent of the subjects 
improved, 27 percent regressed, and 15 percent stayed the same. The 
average gain per pupil during the four and a half month Interval was 
.45 of a school^grade. Elder also found the range of performance to 
be greater in September than in May. An Important limitation in the 
Elder study, though, was the fact that the May test was administered 
almost one month before school adjourned for the summer. 
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Townsend's (1951) Investigation has the same limitation. Class- 
room Instruction continued one month after the spring tests were 
administered and, In the fall, another month of Instruction was carried 
out before the post assessment was conducted. Using the Stanford 
Achievement Tests, and following flfty-slx subjects over three grades 
and two summers, she found the lowest test-retest correlation on the 
Reading subtest to be .883. Even though high correlations between test 
scores were found, she cautioned that care must be exercised when 
Interpreting her data. Correlations between two consecutive fall test 
scores, for example, were usually higher than consecutive spring-fall 
test scores. 

Keyes and Lawson (1937) also tried to determine the stability 
of subjects' standardized test scores over an extended period of time. 
Their subjects originally Included 164 fourth, fifth, and sixth graders 
in Gilbert, Minnesota. The two Investigators tested subjects on the 
Unit Scales of Attainment each fall and spring between 1933 and 1937. 
The test Included eleven subtests: Reading, Arithmetic Operations, 
Problem Solving, American History, Geography, Elementary Science, 
Literature, Spelling, English Usage, Capitalization, and Punctuation. 
Tests were administered one month before school dismissed In May and 
were readmlnlstered one month after school resumed In the fall. The 
Investigators found that the Reading score did not decrease during the 
five-month Interval. On the other hand, the gain was not as great as 
If the subjects would have received five months of Instruction. It Is 
Interesting to note, too, that while the mean Reading score did not 
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decline, there was a loss In the mean Arithmetic, Science, and Literature 
scores. 

Parsley and Powell (1962) randomly selected ninety males and 
ninety females at the second through seventh grade levels with Intel- 
ligence quotients between 90 and 110 as measured by the California Test 
of Mental Maturity . The California Achievement Test was used to deter- 
mine If reading ability was retained over the summer vacation period. 
They found that Reading Vocabulary scores tended to Increase, by grade 
level, over the summer, up to grade five. Or, stated another way, while 
there was a slight loss In mean scores at the second grade level, there 
was no loss at the third grade level and an actual gain at the fourth 
and fifth grade level. A similar trend was evident when Reading Compre- 
hension scores were examined across the grades. 

The relationship between ability to retain skills and Intelli- 
gence Is unclear. Some Investigators, such as Irmlna (1928) and 
Morrison (1924), have been concerned with the gain or loss of Intelli- 
gence over the summer vacation period. Cook (1924 and 1952), however, 
was more Interested In subjectively comparing the summertime academic 
diligence of students with Intelligence quotients above and below 100. 
From her Investigations, she concluded that subjects above 100 IQ, 

. . . were more faithful to their work than those with Intelligence 
quotients below 100 [1942, p. 218 J." Unfortunately, the poor design of 
her study prohibits the drawing of any definite conclusions about the 
effect Intelligence has on retention. 
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Other Investigators take a more sophisticated approach to the 
Intelligence-reading retention question. Parsley and Powell (1962) 
and Orr (1966), for Instance, used Intelligence quotients to Identify 
and group their subjects as "average" or mentally retarded. Trying to 

answer the question relating to interaction between reading and Intel- 

\ 

llgence, Brueckner and Dlstad (192^) found that children scoring lower 
on the Detroit Kindergarten Test lost most In reading ability over the 
summer. Kohlberg (1934) subdivided the Van Wagenen American History 
Scales Into easy, average, and difficult thirds. He discovered that 
subjects with higher Intelligence lost less than did those with lower 
Intelligence. After examining the easiest Items on the test, however, 
he concluded that, "... retention ability on tasks which can be 
accomplished with a great (legrscs of ease cannot be predicted even 
though the mental rating of a pupil Is known [p. 283]." When Kohlberg's 
total group was examined, however, he found no relationship between 
retention and Intelligence. Spltzer (1939), comparing subjects who 
scored on the upper- versus lower-one-third of his test, found: 

" ♦ . . the curve of retention of pupils of Inferior 
learning ability begins to level . . . seven days 
after learning. At the same time the curve for the 
pupils with superior learning ability does not begin 
to level until twenty-one days after the learning 
period [p. 648]." 

Vergason (1966) and Orr (1966) measured the effect of teaching 
hardware on retention ability. Using a palred-assoclate learning task, 
Vergason found that his mentally retarded subjects trained with the 
automated procedure benefitted significantly (p<.05) over subjects 
not receiving the treatment. The method of Instruction-retention 
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Interval was also found to be significant (p<.05), Orr found the 
favorable effects to decrease over one and two month retention Inter- 
vals. The blmodal (audiovisual) procedure used In his experiment did 
not adversely affect retention, however. 

In an attempt to answer the question of the effect of Instruc- 
tional materials on retention ability of bilingual subjects, Arnold 
(1968) administered the Metropolitan Achievement Tests . Primary Level 
II » the Test of Reading, Interamerlcan Serie s. Level 2, and the Prueba 
de Lectura, Serle Interamerlcana . Nlvel 2, to 287 ji'econd graders who 
were receiving three different types of language training and Instruc- 
tion In the AAAS Science Program. The treatment groups were (a) Oral- 
Aural English, (b) Oral-Aural Spanish, and (c) No Oral-Aural. After 
the four months of summer vacation, the No Oral-Aural group showed 
consistent, and In some cases, significant losses. The Oral-Aural 
English and Spanish groups did not differ significantly In retention 
except on the Interamerlcan Series where the differences favored the 
Oral-Aural Spanish group. 

Working with older subjects, Orr (1968) exposed a treatment 
group of sailors to a programmed text while his control group received 
the usual lecture method. After retestlng at one-day, one-week, and 
two-week intervals, using a t-test for correlated means, he found that 
none of the differences reached statistical significance. He conclu- 
ded that the programmed instruction approach enabled his subjects to 
retain as well as those subjects receiving the conventional lecture 
method. 
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Scott (1967), exploring the relationship between retention and 
type oJf Instruction, reported two studies Investigating retention of 
mathematics ability after receiving Instruction In either a modem or 
traditional mathematics program. Using an analysis of variance tech- 
nique, he found no significant differences In retention ability attri- 
butable to the two Instructional programs at the first and second 
grade' In one study. In the other Investigation, no significant dif- 
ferences In retention ability were found at the third, fourth, and 
sixth grade levels. He found a significant difference (p<.01) favor- 
ing the traditional group in the first study, while in the second 
study he found a significant difference (p<.01) favoring the modern 
mathematics group at the fifth grade level. Overall, however, 
there was little difference in retention between the two programs. 

The effect of summer vacation on the retention ability of kin- 
dergarten subjects exposed to two different programs was the focus of 
Hlllerlch's (1965) investigation. He examined subjects' ability to 
use context, find letters, listen for letter sounds, and match letters 
and sounds. Subjects enrolled in kindergartens where a workbook was 
used retained significantly (p<.01) less than non-workbook subjects. 
The mean loss on the fifty-eight items was only 2.15 raw scores points, 
however. Hillerich stated that this was evidence that, "... the 
skills were retained over the summer vacation [p. 317]." 

Educators have always been Interested in the effect of programs 
designed to improve or maintain reading ability during the summer. One 
of the first attempts' to measure the effects of a summer program was 



a study conducted by Cook (1942) • She designed work envelopes that 
Included practice materials for reading and writing, which were sent 
home with first graders for the summer. Second graders received books, 
word lists, and arithmetic fact cards. She found, generally, that 
the less practice during the summer, the greater the loss of ability. 
These data must be Interpreted with caution, however, since the sizes 
of the samples were small and the actual time of posttestlng was not 
mentioned. 

Cook (1952), In another study measuring the effect of a summer 
program designed to Increase reading achievement, devised four differ- 
ent types of summer programs similar to those In her earlier study. 
She found that, . . . whenever children engaged In some systematic 
plan for summer reading, test results Indicated significant Improvement 
over their gain when they participated In no reading plan [p. 415].'' 
Again, her results must be Interpreted with skepticism since no sta- 
tistics were given and yearly gains or losses were not stated. 

Golhor and McCrossan (1966) conducted a more elaborate Inves- 
tigation Into the effects of a summer library club program on the 
reading retention of fourth grade subjects* They found spring reading 
test scores, fourth grade reading scores, and the subjects' Intelli- 
gence test scores to be better predictors of fall reading test scores 
than membership In the summer reading club. While club members did 
score better than nonmembers, this should have been expected since 
all club members were volunteers. And, this study must be Interpre- 
ted In light of the fact that little was known about what actually 
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transpired during the club membership program. The amount and type of 
reading members did was not specified, nor was the total amount of time 
devoted to reading per day explained. 



Hypotheses 

Several trends are evident in studies of summer retention of 
reading ability. First, reading ability has been measured only with 
standardized silent reading tests and never with criterion-referenced 
reading tests. While studies using norm-referenced instruments may 
have provided insights for educators concerned with summative evaluation 
of reading programs, they provide little guidance for teachers who use 
criterion-referenced reading tests for formative evaluations. The 
recent appearance and popularity of criterion-referenced reading pro- 
grams implicitly raises the question of long-term reading skill reten- 
tion. Secondly, the relationship between intelligence and the reten- 
tion of reading ability is unclear. While some investigators have 
measured changes in intelligence scores during the summer vacation, 
few have used intelligence scores to group subjects according to 
above-average, average, and below-average mental ability. Finally, 
the relationship between curricula and retention of reading ability 
is relatively unknown. This is especially true when examining the 
ability of subjects to retain reading ability over the summer vaca- 
tion after being enrolled in either spiral- or objective-based 
curricula during the school year. 



The purpose of this study i then, was to measure the extent to 
which reading ability is retained over the summer vacation. The hypo<- 
theses were: 



1. There will be no significant difference between 
spring and fall Gates-MacGlnltle Reading Tests 
or the Wisconsin Tests of Reading Skill Develop- 
uient reading scores. 

2. There will be no significant difference in re- 
tention ability between males and females. 

3. There will be no significant difference in re- 
tention between subjects of above- aver age » 
average, and below- average mental ability. 

4. There will be no significant difference in re- 
tention ability of subjects enrolled in the 
objective-based reading skills program versus 
subjects enrolled in the basal reader curricula. 



In addition to examining the four hypotheses, answers to the fol- 
lowing questions were sought: 



1. What is the frequency distribution and range 
of scores for each of the reading measures? 

2. Will there be a change in the percentage of sub- 
jects considered to be "masters" of the speci- 
fic reading skills in the spring compared to 
those considered "masters" in the fall? 

3. Will there be a trend toward decreased skill 
mastery over the summer? 



CHAPTER II 



METHOD 



Subjects 

Nine elementary schools from four northeastern Wisconsin school 
districts were included in the study. Eight of the schools were located 
in third class cities while the other school was located in a small 
village.-^ The largest city had a population of 22,902 while the village 
population was 1,524. The median number of years of school completed 
by residents in this geographical area was 12.1 years. ^ Between forty- 
one and forty-eight percent of the employed persons in the area were 
blue collar workers while between thirty-nine and fifty-one percent 
were white collar workers. Approximately ten percent of the adults 
in this area were employed in governmental positions. The median in- 
come was between $10,000 and $11,250 per year while the. median home 
value was $18,000. 



The State of Wisconsin 1971 Blue Book complied by the Wisconsin 
Legislative Reference Bureau, Madison, Wisconsin. 



General S ocial and Economic Characteristlcs-Wispona^n. U.S. 
Department of Commerce, Bureau of the Census, 1970. 



Housing Characteristi cs for State. Cities, and Counties . Vol. 
I, Part 51, Wisconsin, 1970. U. S. Department of Commerce, Social 
and Economic Statistics Bureau, Bureau of the Census. 
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Subjects for the study were 545 first-grade children. This 
group represented all first graders in the nine elementary schools. 
Fewer than one percent of the subjects were American Indian, Orien- 
tal, Spanish-American, Negro or other minority groups.^ Approximately 
one-half of the subjects were enrolled in schools utilizing the 
objective-based program in grade one; the other one-half had received 
instruction in basal reading curricula while in first grade (see 
Table 1). 



TABLE 1 

SCHOOL DISTRICTS, SCHOOLS, DEMOGRAPHIC CHARACTERISTICS AND 
READING CURRICULUM OF SCHOOLS PARTICIPATING IN THE STUDY 



School 
District 


School 


Demographic 
Characteristics 


Reading 
Curriculum 


Hortonville 


Hortonville Elementary 


Village 


Objective-Based 


Kaukaitna 


Nicolet Elementary 


Third Class City 


Basal Reader 


Menasha 


Banta Elementary 


Third Class City 


Basal Reader 


Menasha 


Clovis Grove Elementary 


Third Class City 


Basal Reader 


Menasha 


Gegan Elementary 


Third Class City 


Basal Reader 


Menasha 


Jefferson Elementary 


Third Class City 


Objective-Based 


Menasha 


NicoleL Elementary 


Third Class City 


Objective-Based 


Neenah 


Coolidge Elementary 


Third Class City 


Objective-Based 


Neenah 


Hoover Elementary 


Third Class City 


Objective- Based 



Directory of Public Elementary and Secondary Schools In Selected 

pistrictsj Enrollment and Staff by Racial/Ethnic Group . Fall. 1970.' U.S. 

Department of Health, Education, and Welfare. Office for Civil Rights. 

ERIC 
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Instruments 



Gates-MacGlnltle Reading Test 

Overall reading ability was measured by the Vocabulary and Com- 
prehension subtests of the Gates-MacGlnitle Reading Test . Primary A, 
Forms 1 and 2 (Gates-MacGlnitie, 1965). This test is a norm- referenced, 
standardized instrument. Reading ability is assessed in the following 
manner: 



The Vocabulary Test samples the child's ability to recog- 
nize or analyze isolated words. It consists of 48 
exercises, each of which contains four printed words 
and a picture Illustrating the meaning of one of the 
words. The child's task is to circle the word that 
best corresponds to the picture. The first exercises 
are composed of easy and commonly used words, grouped 
with words selected to be only slightly similar or con- 
fusing. Gradually the words become less easy and common 
and are presented with words more similar in details and 
general appearance. 

The Comprehension Test measures the child's ability to 
read and understand whole sentences and paragraphs. 
This ability Includes many skills not involved in the 
mere ability to recognize words. The child must grasp 
the total thought clearly If he is to answer correctly. 
The test contains 34 passages of increasing length and 
difficulty. Each passage is accompanied by a panel of 
four pictures. The child's task is to mark the pic- 
ture that best illustrates the meaning of the passage 
or that answers the question in the passage (Gates- 
MacGlnitie, 1965, p. 1). 



Alternate form reliabilities between Forms 1 and 2 of the test 
are .86 for the Vocabulary subtest and .83 for the Comprehension subtest 
while split-half reliabilities for the two subtests are .91 and .94 
respectively. 



ERIC 
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Wisconsin Tests of Reading Skill Development 

Specific reading skills were measured by the Wisconsin Tests of 
Reading Skill Develop ment -Word Attack (WTRSD-WA) , Level B, Forms 1 and 
2 (Otto, et al., 1970). The Level B battery was selected for admlnlatra 
tlon since, according to the program guidelines, it was most suitable 
for administering to fast, average, and slow students at the beginning 
of second grade. Moreover, this battery Is primarily designed for 
pupils who would be reading at the primer or first reader level. 

The Wisconsin Tests of Reading Skill Development are criterion- 
referenced and are not standardized. The WTRSD-WA measure sight vocabu- 
lary, phonic and structural analysis skills. The skills assessed and 
a brief description of each te£jt at Level B follow: 



Test 1-Slght Vocabulary 

For each sentence In Test 1 the test administra- 
tor displays a flashcard on which Is printed a 
word from the preprlmer and primer levels of the 
Dolch Basic Word List. Response choices of "yes" 
or "no" are made to Indicate whether these words 
fit contextually within the given sentences (20 
Items). 

Test 2-Be8lnnlng Consonant Sounds 

For the first ten Items the child selects from 
four response choices per Item the beginning 
consonant sound that he hears In dictated non- 
sense words. With response choices of "yes" 
and "no" he determines for the remaining ten 
Items whether two dictated nonsense words per 
Item have the same Initial consonant (20 Items). 

Test 3-Ending Consonant Sounds 



For the first ten Items the child selects from 
four response choices per Item the ending 



consonant sound that he hears In dictated non- 
sense words. With response choices of ''yes" 
and "no'' he determines for the remaining ten 
Items whether two dictated nonsense words per 
, Item have the same final consonant (20 Items). 

Test 4-Consonant Blends 

In response to dictated nonsense words the child 
selects from four response choices per Item the 
blend that he hears In each nonsense word. 
Blends tested are bl, cl, fl, £l, pit si, br, 
^» il> ll> £Lf and tr (20 Items). 

Test 5-Rhymlng Elements 

Test 5 measures the ability to select from four 
printed response choices per item the word that 
rhymes with a printed stimulus word (20 Items). 

Test 6-Short Vowels 

Fifteen Items with response choices of a, e^, 
if Of and u test the child's recognition of the 
short vowel heard In dictated nonsense words (15 
Items). 

Test 7-CQnsonant Digraphs 

In response to dictated nonsense words the child 
selects from four response choices per Item the 
digraph that he hears In each nonsense word. Di- 
graphs tested are ch, sh, and th (17 Items). 

Test 8-Compound Words 

The child selects the compound word from three 
printed response choices read by the test admini- 
strator (17 items). 

Test 9-Contractlons 

Test 9 measures the ability to select the cor- 
rect contraction for use within a given sentence. 
There are four response choices for each sentence 
(15 items). 

Test 10-Base Words and Endings 

The child Identifies from three printed respoti'^- 
choices the one with the base or root word under- 
lined (12 Items). 
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Test 11-Plurals 

Test 11 measures the child's ability to recog- 
nize printed words as representing "one" or 
"more" than one (12 items). 

Test 12-Possessives 

The child selects the phrase containing a pos- 
sessive from three printed response choices per 
item read by the test administrator (20 items) 
(Miles, et al., 1970, p. 3-4). 

Alternate form reliabilities of the Level B, Word Attack subtests 
range from a low of .48 (Test 8-Compound Words) to a high of .83 (Test 
7-Consonant Digraphs). Most of the tests have alternate form reliabili- 
ties between .70 and .80. Split-half reliabilities for the tests were 
not available since the technical manual for the instruments had not 
been produced at the time of testing. 

California Short-Form Test of Mental Maturity 

The Californi a Short-Form Test of Mental Maturity . Level 0, con- 
sists of seven subtests which purport to measure four factors (Sullivan, 
et al., 1963). The seven subtests are (a) Opposites, (b) Similarities, 
Cc) Analogies, (d) Numerical Values, (e) Number Problems, (f) Verbal 
Comprehension, and (g) Delayed Recall. The seven subtests are grouped 
to form four factors: Logical Reasoning, Numerical Reasoning, Verbal 
Concepts, and Memory. When all four factors are combined, a Total 
Intelligence score is derived. 

Curricula 

Subjects were divided into two curriculum categories; those 
receiving objective-based Instruction while in first grade and those 
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Instructed In the basal reader curricula. All students who were grouped 
for Instruction on the basis of test results from the Wisconsin Tests of 
Reading Skill Development-Word Attack were grouped in the objective-based 
category. Objective-based instruction is designed to give instruction 
to children when there is a need. Basically, It Is a framework for 
instruction based on four points. First, the iden/tif Ication of essen- 
tial skills is undertaken. Secondly, specific behavioral objectives are 
stated for each of the skills. The objectives specify a criterial level 
used to judge adequacy of performance. Third, criterion-referenced 
assessment exercises are administered to assist teachers in determining 
which skills have and which have not been mastered. Pupil performance, 
then, is evaluated with regard to an absolute or criterion referent. 
Finally, appropriate teaching/learning activities are identified which 
permit teachers to organize instruction in line with diagnosed student 
needs. The salient features of the objective-based curriculum group, 
then, included: 

1. Administering the Wisconsin Tests of Reading Skill Develop- 
ment-Word At tack . 

2. Sched iling a minimum of 120 minutes per week for pupil word 
attack skill development, 

3. Forming skill groups on the basis of student need by beha- 
vioral objectives, 

4. Forming ad hoc word attack skill groups at . least every three 

weeks . 

5. At the end of each three-week skill group, reassessing stu- 
dent skill development, 

ERIC 
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Students enrolled In schools which did not use the Design and which 
did not group for class instruction on the basis of Wisconsin Tests of 
Reading S kill Development-Word Attack or other commercial ly available di- 
agnostic reading test results were categorized as the basal reader curri- 
cula subjects. These curricula can be described as: 

1. Utilization of a commercially available basal reader and an 
accompanying workbook of worksheets. 

2. The absence of any commercially available objective-based di- 
agnostic word attack testing program. 

3. The absence of systematic ad hoc word attack skill grouping 
as a basis for skill instruction. 

The basal reading programs in the nine elementary schools included 
materials from the following publishers: American Book, Glnn, Harper and 
Row, Houghton-Mifflin, Lippincott, MacMlllan, and Scott Foresman. 

Procedure 

Initially, the investigator conducted an in-service training pro- 
gram for key personnel in each of the nine elementary schools. The 
group Included school principals, reading teachers, and, in some cases, 
first-grade teachers. The rationale for the study and the testing pro- 
cedures which were to be employed were discussed at this time. Partici- 
pants had an opportunity to become familiar with the tests and the testing 
schedules to be followed during the investigation. Ample opportunities 
were also provided for participants to ask questions about the study. 
Representatives from each of the schools agreed to participate. 
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The second phase, local staff training for first- and second- 
grade teachers, was conducted by the school representative who attended 
the Initial In-servlce training session. The Investigator agreed to 
conduct the local In-servlce program for all personnel who desired 
assistance, but only one local staff trainer requested this assistance. 

The testing strategy employed required the subjects* regular 
classroom teacher to administer all the tests. Earlier pilot studies 
by the Investigator showed this procedure to work well with young chil- 
dren. And, because of the large number of subjects to be tested within 
the course of a week, teachers were in a better position to administer 
the Instruments than was the investigator. 

All first-grade teachers in the study administered the Wisconsin 
Tests of Reading Skill Development -Word Attack . Level B, Form 1, the 
Gates-MacGlnitle Reading Test . Primary A, Forms 1 and 2, and the Cali- 
fornia Short-Form Test of Mental Maturity two weeks prior to school 
being dismissed for the summer vacation. Testing was conducted in five 
sittings, one sitting each day of the week. To reduce the chance of 
a testing order effect, the schools were randomly assigned to three 
categories, and the tests were administered according to a randomly 
derived testing schedule (see Table 2). 

The fall resting program was similar to the spring testing sche- 
dule. Primarily, the major differences were (a) all testing was done 
by the second-grade teachers, (b) the California-Short Form Test of 
Mental Maturity was not readmlnlstered, and (c) Form 2 of the Wisconsin 
Tests of Reading Skill Development . Level B, was administered. The fall 
testing program was conducted the second full week of school In each of the 

ERIC 
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TABLE 2 

SPRING TEST ADMINISTRATION SCHEDULE 



Schools and Testing Order 



Sitting 
and 
Test 


Gegan 
Coolldge* 
Hoover 


Banta* 

Nlcolet/ 
Menasha* 


Nlcolet/ 

ITAllIf Aim A 
XVCI UlVCIIUiCi 

Clovls Grove 
Hortonvllle* 


Sitting A 








Gates-MacGlnltle 
Reading Test- 
I. xuiciry t\f rorm x 
(40 Minutes) 


4 


4 


2 


Sitting B 








California Short-Form 
(34 Minutes) 






<• 

1 


Sitting C 








WTRSD-WA, Level B, Form 1 
Tests 1, 3, 4, 5 
(50 Minutes) 


3 


1 


5 


Sitting D 








WTRSD-WA, Level B, Form 1 
Tests 6, 7, 8, 9 
(40 Minutes) 


1 


2 


3 


Sitting E 








WTRSD-WA, Level B, Form 1 
Tests 10, 11, 12, 13 
(35 Minutes) 


5 


5 


4 



*Schools administering Form 2 of the Gates-MacGlnltle Reading Test- 
Primary A 
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respective districts. Again, the testing order for administering the 
tests was derived randomly (see Table 3). 

Analysis 

Upon completion of the spring and fall testing programs, all 
tests were delivered to the investigator. Gates-MacGinitie Reading Tests , 
the California Short-Form Test of Mental Maturity , and the Wisconsin 
Tests of Reading Skill Development . Level B, Form 2, were hand-scored 
by a staff of four individuals hired by the investigator. The investi- 
gator spot-checked randomly, as the tests were being scored, in order to 
check for a high degree of scoring accuracy. The Wisconsin Tests of 
Reading Skill Development . Level B, Form 1, were machine scored with the 
computer scoring service provided by the printer of the materials. 
National Computer Systems. 

All raw test data was coded on eighty field, twenty-five subject 
coding sheets. The coding was done by two individuals trained by the 
investigator; one of whom was a student enrolled in the Computer Sciences 
program at the University of Wisconsin-Madison, the other a full-time 
University secretary. 

Coded test data were key punched by two qualified, full-time 
University of Wisconsin-Madison key punchers. All of the data were 
verified for key punching accuracy. 

The computer program was written by a computer programmer em- 
ployed at the Wisconsin Research and Development Center for Cognitive 
Learning. A multiple analysis of variance program and descriptive 
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TABLE 3 

FALL TEST ADMINISTRATION SCHEDULE 



Schools and Testing Order 



Sitting 
and 
Test 


Gegan 
Coolldge* 


Banta* 
Jefferson 
Nicolet/ 
Menasha* 


Nicolet/ 
Kaukauna 
Clovls Grove 
Hortonvllle* 


Sitting A 








Gates-MacGlnltle 
Reading Test- 
Primary A, Form 2 
(40 Minutes) 




3 


4 


Sitting C 








WTRSD-WA, Level B, Form 2 
Tests 1. 3. 4. 5 
(50 Minutes) 




O 

c 


1 


Sitting D 








WTRSD-WA, Level B, Form 2 
Tests 6, 7, 8, 9 
(40 Minutes) 


3 


1 


2 


Sitting E 








WTRSD-WA, Level B, Form 2 
Tests 10, 11, 12, 13 
(35 Minutes) 


4 


4 


2 



*Schools administering Form 1 of the Gatea-MacGlnltle Reading Tes t- 
Prlmary A ' 



"4^ 

statistics were used to analyze the data. Only subjects for which com- 
plete data were available were Included In the analysis. In addition, to 
determine If Intelligence of subjects had an effect on retention of over- 
all reading ability or specific reading skills, subjects In the thlrd- 
and seventh stanlnes on the California Short-Form Test of Mental Maturity 
were not included in the analysis of the data. Eliminating these sub- 
jects permitted three distinct Intelligence groups, each separated from 
one another by one stanlne. By excluding the third- and seventh-stanlne 
subjects from the analysis and excluding subjects for which complete data 
were not available, a final sample of 311 subjects remained. 

In summary, then, to determine the degree of retention, mean spring- 
fall test scores of all subjects were compared. This was the dependent 
variable. Sex of subject, intelligence, and school curriculum were also 
examined in an attempt to determine whether these three variables influ- 
enced the ability of subjects to retain overall reading ability or reading 
skills. These three factors were considered to be the independent vari- 
ables. A 2 x 3 x 2 factorial design using the multivariate analysis of 
variance statistics technique was used to determine whether a relation- 
ship existed between the variables. The factorial table for the study 
is found in Appendix A. 



CHAPTER III 



FINDINGS 



In this chapter, the differences In spring and fall reading 
test scores of males and females, between subjects of below-*average, 
average, and above-average Intellectual ability, and between subjects 
enrolled In the two reading curriculum categories are examined. Results 
from each of the tests will be discussed In terms of changes In the 
mean raw scores and the significance of the changes. Descriptive 
Information pertaining to the frequency and range of scores will be 
provided. Changes in the number and percentage of subjects considered 
to have mastered the specific reading skills between the spring and 
fall will also be discussed. In addition, histograms illustrating 
the trend in the changes of scores will be shown throughout the 
chapter. ^ 

The purpose of this chapter is to provide the reader with the 
relevant data to Illustrate the nature of changes in reading scores 
over the summer vacation period. These data will enable the reader to 
understand better the effect the non-instructional summer period has 
on reading test scores. The data are discussed and the conclusions 
are examined in Chapter IV. 
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Retention of Overall Reading Ability 

Gates-MacGlnltle Reading Test-V cabulary 

The range of reading scores on the Vocabulary subtest of the 
Gates-MacGlnltle Reading Test was thlrty-slx raw score points on the 
spring test and forty-four raw score points on the fall test (see Table 
4). Thus, thfi range of scores on the faix test was eight points grea- 
ter than on the spring test. Few subjects achieved a score of fifteen 
or less on either the spring or fall test. Instead, the trend was In 
the opposite dlrectlc-a as Illustrated by the fact that over one-half 
of the subjects achieved a score of forty or more on both tests. 

The change between the mean spring and fall scores amounted to 
a loss of 1.35 raw score points (see Table 5). The analysis of vari- 
ance treatment with one degree of freedom revealed that the loss between 
spring and fall was significant at the .001 level (see Table 6). To 
determine whether sex of subject. Intelligence, and the type of school 
reading curriculum were related to retention of thp Vocabulary measure, 
another analysis of variance treatment was performed. None of the 
Independent variables was found to be a significant factor affecting the 
retention ability of first-grade subjects (see Table 7). 

Figure 1 Illustrates the large differences between spring and 
fall tests for a number of the subjects. One person, for example, 
had a difference of forty points between his spring and fall test 
scores. Most of the change scores were not this great, however. 
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TABLE 4 

FREQUENCY DISTRIBUTION OF GATES-MACGINITIE 
READING TEST, PRIMARY A, VOCABULARY TEST SCORES (N=313*) 



Raw Score 


Spring 


Fall 




Raw Score 


Spring 


Fall 


0 








25 


2 


3 


1 








26 


4 


6 


2 




**** 




27 


6 


6 


3 








28 


4 


5 


4 




1 




29 


4 


14 


5 








30 


6 


2 


6 








31 


7 


8 


7 








32 


8 


7 


8 








33 


7 


10 


9 








34 


7 


7 


10 


"" 






35 


9 


8 


11 




1 




36 


12 


8 


12 


1 






37 


9 


8 


13 




1 




38 


9 


5 


14 




1 




39 


9 


6 


15 




2 




40 


18 


3 


16 


1 






41 


18 


16 


17 


1 


2 




42 


6 


13 


18 




3 




43 


12 


16 


19 


3 


4 




44 


14 


17 


20 


1 


2 




45 


22 


18 


21 


4 


2 




46 


22 


31 


22 


1 


4 




47 


38 


24 


23 


2 


5 




48 


41 


41 


24 


5 


2 











*Data in all frequency distribution tables based on 313 subjects; two 
students failed to have a Total Intelligence stanine score but had 
taken the entire battery. All statistical tests for significance 
were based on 311 subjects, however. 
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TABLE 5 



MEAN SPRING AND FALL TEST SCORES, CHANGE SCORES, AND 
STANDARD DEVIATIONS FOR OVERALL READING ABILITY 
AND SPECIFIC READING SKILL ABILITY 



Variable 


Mean 


S.D. 


Gates -Ma cGlnltle-Voc. 


— 


Spring 


39.72 


7.91 


Gates-MacGlnltle-Voc. 


— 


Fall 


38.37 


9.28 


Gates-MacGlnitle-Voc. 




Change 


- 1.35 


— 


Ga t es -Ma cG In i 1 1 Comp . 


— 


Spring 


23.60 


7.34 


Gates-MacGlnitle-Comp. 


— 


Fall 


22.80 


8.26 


Gates-MacGlnltle-Comp. 




Change 


- .80 


— 


WTRSD-Slght Vocabulary 


— 


Spring 


17.59 


2.47 


WTRSD-Sight Vocabulary 


— 


Fall 


16.55 


3.02 


WTRSD-Sight Vocabulary 




Change 


- 1.04 


— 


WTRSD- Beginning Cons. 


— 


Spring 


18.31 


2.21 


WTRSD-Beginning Cons. 


— 


Fall 


17.69 


2.33 


WTRSD-Beglnnlng Cons. 




Chanse 


- .62 


— 


WTRSD-Ending Cons. 




Spring 


17.60 


2.62 


WTRSD-Endlng Cons. 




Fall 


16.67 


3.37 


WTRSD-Endlng Cons. 




Change 


- .93 




WTRSD-Cons. Blends 




Spring 


17.19 


3.62 


WTRSD-Cons. Blends 




Fall 


16.10 


4.13 


WTRSD-Cons. Blends 




Change 


- 1.09 




WTRSD-Rhyming Elements 




Spring 


16.79 


4.78 


WTRSD-Rhyming Elements 




Fall 


14.87 


5.87 


WTRSD-Rhyming Elements 




Change 


- 1.92 





CONTINUED 



CONTINUED 



TABLE 5 



MEAN SPRING AND FALL TEST SCORES, CHANGE SCORES, AND 
STANDARD DEVIATIONS FOR OVERALL READING ABILITY 
AND SPECIFIC READING SKILL ABILITY 



Variable 


Mean 


S.D. 


WTRSD-Short Vowels 


— 


Spring 


11.28 


4.11 


WTRSD-Short Vowels 


MM 


Fall 


10.65 


4.03 


fV J>I\OI^ QllUt U VUWCX9 




wnange 


- .63 


— 


WTRSD-Cons. Digraphs 


— 


Spring 


13.62 


4.20 


WTRSD-Cons. Digraphs 




Fall 


11.98 


4.47 


W X lvDU**UUno • UXgL apns 




Vjuange 


- 1.64 


— 


WTRSD-Compound Words 


— 


Spring 


13.77 


3.16 


Wl'RSD- Compound Words 


MM 


Fall 


13.17 


3.58 


wxivDu^Liuiiipuuna woros 




Linange 


- .60 

' 


— 


WTRSD-Contractlons 


— 


Spring 


10.77 


4.15 


w i KaiT'Loncr act ions 




Fall 


9.58 


4.37 


WTRSD-Contractlons 




Change 


- 1.19 


— 


WTRSD-Base Words 




Spring 


8.74 


3.06 


WTRSD-Base Words 




Fall 


8.95 


3.00 


WTRSD-Base Words 




Change 


+ .21 




WTRSD-Plurals 


mm mm 


Spring 


10.51 


1.75 


WTRSD-Plurals 




Fall 


10.46 


2.26 


WTRSD-Plurals 




Change 


- .05 




WTRSD-Possesslves 




Spring 


17.05 


4.13 


WTRSD-Pos sess Ive s 




Fall 


17.2'J 


3.91 


WTRSD-Possessives 




Change 


+ .IB 





32 
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Figure 1 

Changes in Raw Scores on the Oates-MacOlnltle 
r^eadlng Test, Primary A, Vocabulary 
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Figure 2 

Changes in Raw Scores on the Oates-MacOinltie 
Reading Test, Primary A, Comprehension 
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(;ateS"MacGlnltIe KoadlnR Test-Comprehension 

The range of scores for the Comprehension portion of the Gates- 
MacGlnltle test followed a pattern similar to that of the Vocabulary 
measure. That Is, the range of scores In the fall was greater than In 
the spring (see Table 8). The low spring score was seven; the low fall 
score, four. The high score for both the spring and fall tests was 
thirty-four points. 

Like the Vocabulary measure, the fall mean score was lower than 
the spring test score (see Table 5). While the loss was less than one 
raw score point, it was still significant at the .01 level of confi- 
dence (see Table 6). Sex of subject. Intellectual ability, and type 
of school curriculum, however, were not found to be significantly rela- 
ted to retention of comprehension ability (see Table 7). 

The differences between subjects* spring and fall test scores 
were not as widely distributed on the Comprehension measure as they 
were on the Vocabulary test (see Figure 2). Most of the changes were 
within a gain or loss of eight points or less. 

Retention of Specific Reading Skills 

WTRSD-Sieht Vocabulary 

The range of scores on the measure of sight vocabulary was grea- 
ter In the fall than In the spring (see Table 9). The low and high 
scores for the spring and fall were 6-20 and 1-20 respectively, the 
range being five points greater for the fall. The range for the fall 
test is somewhat misleading » however • since only one subject received 
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TABLE 8 

FREQUENCY DISTRIBUTION OF GATES-MACGINITIE 
READING TEST, PRIMARY A, COMPREHENSION TEST SCORES 
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TABLE 9 

FREQUENCY DISTRIBUTION OF WTRSD- 
SIGHT VOCABULARY TEST SCORES 
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a score of one when school resumed. Almost one-half of the subjects 
received perfect scores or missed only one Item on the spring test while 
approximately thirty percent of the subjects achieved this well In the 
fall. 

The raw score change between the mean spring and mean fall tests 
was -1.04 which was highly significant at the .0001 level of confidence 
(see Table 6). There was no significant difference between scores of 
males and females, between groups of different Intellectual ability, 
or between subjects in the objective-based and basal reader groups 
(see Table 7). 

In an attempt to determine whether the difference between spring 
and fall test scores had any pedagogical significance, the number and 
percentage of subjects who were classified as "masters" (achieving a 
score of eighty percent correct or higher on a specific skill test) versi 
"nonmasters" (a score of less than eighty percent correct) was compared 
(see Tables 10-13, pp. 39-42). Generally, in the objective-based group, 
about twenty to thirty percent fewer males could be considered "mas- 
ters" in the fall, while only between eight and sixteen percent fewer 
of the females could be considered "masters." In the basal reader 
group, as many as forty-two percent of the males needed to be reclas- 
sified from "masters" to "nonmasters." The percentage of females 
changing from "masters" to "nonmasters" in the basal reader group 
was about the same in number as their objective-based, female, peers. 
A histogram Illustrates that most of the changing of scores between 
spring and fall fell within the -3 and +1 parameters (see Figure 3, 
p. 48). 
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WTRSD-Beglnnlne Consonants 

The low and high scores on this test v/ere the same for both 
spring and fall (low » 7, high - 20). The range was thirteen raw score 
points (see Table 14). Over two-thirds of the subjects scored eighteen 
points or higher on both the spring and fall tests. 

The mean raw score change between the two tests was *-«62 which 
was significant at the .0001 level, the same as the Sight Vocabulary 
test (see Table 6). Sex of subject, IQ, and school cttrrlculum were 
not significant factors affecting retention (see Table 7)« 

A higher percentage of subjects was categorized as '^masters'' on 
this test than on any other measure (see Table 11). And, the percentage 
of average ability males In the basal reader group that needed to be 
reclassified as **masters" In the fall actually Increased by twenty-five 
percent (see Table 12). Generally, however, there was relatively lit- 
tle change In the percentage nf "masters" between spring and fall In 
either curriculum category. 

The general stability of scores can be seen by examining 
Figure 4, p. 48. Almost all of the changes In scores occurred between 
-2 and +2. 

WTRSD-Endlng Consonants 

The low score for the Ending Consonants test was six points In 
the spring and five points In the fall (see Table 15, p. 45). High 
scores of twenty were reached for both spring and fall tests. 

While a loss of slightly under one point resulted when the two 
mean scores were compared, It was statistically significant at the 
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TABLE 14 

FREQUENCY DISTRIBUTION OF WTRSD- 
BEGINNING CONSONANTS TEST SCORES 
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KRISQUENCY DISTRIBUTION OF WTRSD- 
ENDING CONSONANTS TEST SCORES 
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19 
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54 


20 
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.0001 level. Sex, IQ, and school curriculum, however, did not have 
significant effects on retention ability (see Table 7). 

The largest loss from "mastery" to "nonmastery" occurred in 
above- average, objer.tive-based program males where twenty-one percent 
fewer subjects were considered to be "masters" in the fall (see Table 
10). 

Most subjects had change scores which were generally in the -3 
to +1 range (see Figure 5, p. 48). 

WTRSD-Consonant Blends 

Identical low and high spring and fall test scores were found on 
this measure. A score of three was the low while a score of twenty was 
the high (see Table 16, p. 47). 

The dif .ence between the spring and fall mean test scores 
resulted in a loss of more than one point (i e Table 5). Again, this 
loss was significant at the .0001 level of confidence (see Table 6). 
And, again, sex of subject, IQ, and school curriculum were not found 
to be significantly related to retention ability (see Table 7). 

Like all of the previous specific skill tests, most of the 
above-average intelligence group subjects were identified as "masters" 
(see Tables 10-13). Interestingly, subjects taught with basal readers 
were not as prone to be recategorized as were objective-based curricu- 
lum subjects. This was true for females as well as males. While al- 
most twenty-five percent of objective -based curriculum males went from 
the "mastery" to "nonmastery" category, only about twelve percent of 
the basal reader group males chongecf categories. Moreover, only about 
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TABLE 16 

FREQUENCY DISTRIBUTION OF WTRSD- 
CONSONANT BLENDS TEST SCORES 
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five percent of the above-average, basal reader group females changed 
categories. 

Most of the changes in subjects' scores between spring and fall 
were between the -2 and +1 categories (see Figure 6). 

WTRSD-Rhyming Elements 

The Rhyming Elements test was the specific skill measure on which 
the greatest range of scores was found. Both the spring and the fall 
results indicated low scores of zero and high scores of twenty. Inter- 
estingly, over one-third of all subjects made perfect scores during 
the spring test (see Table 17, p. 50). 

The Rhyming Elements test was also the test on which the great- 
est change score was found. The mean spring score of 16.79 and the 
fall score of 14.87 resulted in a change score of -1.92. As might be 
expected, since this change of scores was the largest difference 
found between any of the tests, it resulted in a highly significant 
loss at the .0001 level of confidence (see Table 6). Sex of subject 
and curriculum group were not found to be related to retention of 
test scores. The average IQ group was found to have a significantly 
greater (df » 2, MS = 133.86, F = 6.10, p<.01) mean loss than the 
above-average IQ group, however (see Table 7). 

The percentage of male and femila masters in the basal reader 
group was relatively low when cc npared with other specific reading 
skill test "masters" (see Tables 12 and 13). There was a twenty-five 
percent change from "nonmastery" to the "mastery" caceHOfy for above- 
average, basal reader males, however. 
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TABLE 17 

FREQUENCY DISTRIBUTION OF WTRSD- 
RKYMING ELEMENTS TEST SCORES 
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The distribution of change scores was also Interesting to 
examine. Almost one* third of the subjects* did not change between 
spring and fall (see Figure 7, p. 57). A number of subjects, neverthe-^ 
less, experienced losses of eight and more raw score points. 

WTRSD-Short Vowels 

A low score of one and a high of fifteen were recorded on the 
spring test while scores of zero and fifteen marked the low and high 
parameters for the fall test. A large number of subjects fell within 
the five-to-ten items correct range on this measure (see Table 18). 

The loss between the mean spring and fall tests was -.63, 
slightly more than one-half of a full raw score point (see Table 5) • 
Even so, this was still enough to result in a significant loss at the 
>0001 level (see Table 6). While there was a loss between the spring 
and fall mean scores, there was no significant difference in reten- 
tion ability between subjects of different sexes. Intellectual ability, 
or between types of school reading curriculum (see Table 7). 

Generally, there was a smaller percentage of fall ^Wsters** than 
spring "masters" with the exception of below-average intelligence 
females enrolled in the objective-based program (see Table 11) and 
average intelligence males in the basal reader curricula (see Table 
12). The Increase was slight, however. 

Approximately one-third of the subjects' scores did not change 
between spring and fall. And, when a change did occur, It was usually 
either a gain or loss of only one raw score point (see Figure 8, p. 57). 

ERIC 
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TABLE 18 

FREQUENCY DISTRIBUTION OF WTRSD- 
SHORT VOWELS TEST SCORES 
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WTRSD- Consonant Digraphs 

The ranges of scores on the spring and fall tests were almost 
Identical. On the spring test, one person failed to score while a 
large number of subjects achieved a perfect score of seventeen. While 
the range of scores was slightly lower for the fall test (1-17), there 
was a noticeable shift downward In the scores (see Table 19). 

The spring mean raw score of 13.62 and the fall mean raw score 
of 11.98 resulted In a net loss of -1.64 raw score points, the second 
greatest difference on any of the tests. The analysis of variance 
treatment Indicated a significant loss at the .0001 level (see Table 
6). Sex of subject and school curriculum were found not to be signifi- 
cant factors effecting retention ability while IQ was significantly 
related (df = 2, MS » 25.18, F = 3.58, p<.05) to retention ability^ 
(see Table 7). Specifically, subjects In the average IQ group loot 
significantly more than their less Intelligent peers. 

Generally, a smaller percentage of male subjects In the cbjec- 
tlve-based group changed from the "masters" to "nonmasters" group when 
compared to basal reader group males. The same was not true, however, 
of females. In their case, there was no apparent pattern In changes 
from the "mastery" to "nonmastery" categories or vice versa (see Tables 
10-13). 

As might be anticipated, the overall trend of scores, as Illu- 
strated by the histogram, was toward the loss side of the scale rather 

« 

than toward the gain side (see Figure 9, p. 57). 
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FREQUENCY DISTRIBUTION OF WTRSD- 
CONSONANT DIGRAPHS TEST SCORES 
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WTRSD -Compound Words 

The low score and high score was the same for both the spring 
and fall tests (see Table 20, p. 56). While there was a general down- 
ward trend for the fall scores, the shift was not great. In fact, the 
overall loss between the spring and fall mean test scores was only 
-.60. While this still reached significance (p<.001). It was the least 
significant of the Wisconsin Tests of Reading Skill Development change 
scores which reached statistical slgnif lance (see Tables 5 and 6). 

And, while the change score between means was found to be sig- 
nificant, the three Independent variables of sex of subject, IQ, and 
school curriculum were not significantly related to retention ability 
(see Table 7). 

The percentage of subjects recategorlzed on the "mastery- 
nonmastery" criteria was relatively small (see Tableis 10-13). There 
was an actual Increase in "masters" for the average, ale, basal 
reader group. Another Interesting phenomenon was discovered for 
above-average ability subjects. In their case, there was almost no 
change in the perccnLage of subjects ueedlng to be recategorlzed 
between spring and fall. This was also reflected in the histogram 
where an almost "normal" bell-shaped curve of change scores appeared 
(see Figure 10, p. 57). 

WTRSD- Con t rac t ions 

Just as was found on the Beginning Consonants, Rhyming Ele- 
ments, and Compound Words reading skill tests, the range of scores 

ERIC 



TABLE 20 

FREQUENCY DISTRIBUTION OF WTRSD- 
COMPOUND WORDS TEST SCORES 
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on the Contractions test did not change between the spring and fall. 
The low score on this test was zero while the high score was fifteen 
points (see Table 21). 

A difference of -1.19 points was found between the spring and 
fall mean scores of 10.77 and 9.58, respectively. The loss was sig- 
nificant at the .0001 level of confidence when the analysis of vari- 
ance treatment was applied (see Table 6). 

None of the three Independent variables (sex, IQ, and type of 
school reading curriculum) was found to be significantly related to 
retention ability of this skill (see Table 7). 

A large percentage of the basal reader group needed to be reclas- 
sified as "nonmasters" after the fall testing took place (see Tables 
12 and 13). Between one-fifth and one-fourth of the males turned out 
to be "nonmasters" In the fall while one-third of the average Intelli- 
gence females In this group moved from the "mastery" to the "nonmas- 
tery" category. Generally, the changes In the objective-based group 
were not as great. 

The histogram was less "peaked" and its base was broader than 
many of the other histograms (see Figure 11, p. 66). This Illustrated 
the trend for changes In scores to be distributed over a wider range 
than was true for many of the specific skill tests. 

WTRSD-Base Words 

Again, the range of scores was Identical for the spring and fall 
test scores. A score of zero was the recorded low while the high was 
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FREQUENCY DISTRIBUTION OF WTRSD- 
CONTRACTIONS TEST SCORES 




60 



the maximum achievable score ol twelve. The frequency distribution of 
scores remained almost unchanged between the spring and the fall. Only 
a slight upward trend In scores was noticeable (see Table 22, p. 61). 

This was one of two tests on which a loss between the two mean 
scores was not found over the summer vacation period. The spring mean 
score of 8. 74 and the fall mean score of 8.95 resulted In a gain of 
.21 points (see Table 5). While the change of almost one-fourth of 
a raw score point was In the positive direction, it was not great 
enough to reach statistical significance (see Table 6). Moreover, 
none of the Independent variables reached significance either (see 
Table 7). 

There was relatively little change in the "mastery" versus "non- 
mastery" categories for the objective-based reading curriculum group. 
The one exception was for below-average IQ females where twenty-two 
percent of the group changed from "masters" to "nonmasters" (see 
Table 11). The basal reader curricula group experienced no decline in 
the number of "masters." In fact, the inverse was true. There were 
actually Increases in the number of "masters" in the average intelli- 
gence male category as well as the above-average Intelligence female 
group (see Tables 12 and 13). The latter group had in Increase of 
nineteen percent in the number of "masters." 

The pictorial representation of scores on the histogram revealed 
a slight upward trend in change scores (see Figure 12, p. 66). Almost the 
same number of subjects gained a raw score point, for example, as 
those who had no change between their spring and fall test scores. 
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FREQUENCY DISTRIBUTION OF WTRSD- 
BASE WORDS TEST SCORES 
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WTRSD-Plurals 

On the Plurals specific skill measure, the range of scores In the 
spring was less than In the fall. The low of two points and the high of 
twelve points was substantially narrower than the fall test low of zero 
and the high of fourteen. It was also Interesting to note the sharp 
Increase In perfect test scores for the fall (see Table 23). 

The spring and fall mean test scores were almost Identical; 
10.51 and 10.46. The loss of only -.05 of a raw score point was not 
found to be significant nor were sex of subject, IQ, or type of school 
reading curriculum found to be significantly related to retention of 
the skill (see Tables 5-7). 

With the exception of twenty-three percent of the below^average 
ability females changing categories, there were almost no changes in 
the "mastery-nonmastery" objective-based curriculum groups. Approxi- 
mately fifteen percent of the average ability males and fifteen percent 
of the average ability females in the basal reader curricula group, 
however, went from the "masters" to the "nonmasters" categories (see 
Tables 12 and 13). And, strangely, about one-fourth of the above- 
average ability females in the basal reader curricula group went from 
being considered "nonmasters" to "masters." 

A large number of subjects' scores did not change between the 
spring and fall testing sessions. The histograms revealed, in fact, 
that most of the changes could be categorized between -2 and +2 para- 
meters (see Figure 13, p. 66). 
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WTRSD-Possesslves 

As on six of the previous eleven tests of specific reading skills » 
the range of scores for the spring and fall remained the same. In the 
case of the Possesslves test, the low score was three points while the 
high was twenty points (see Table 24). This test was the second measure 
on which there was no spring- to- fall loss. Instead, a slight gain 
(+.18) was found between the spring mean raw score of 17.05 and the 
fall mean raw score of 17.23 (see Table 5). The Possesslves test was 
the third measure on which no significant gain or loss was found (see 
Table 6). Sex of subject » Intellectual ability, and type of reading 
curriculum were also found to be not significant variables effecting 
retention ability of first-grade subjects (see Table 7). 

For objective-based curriculum subJectSy there was very little 
change In the number of subjects which were considered "masters" In 
the spring versus "masters" In the fall (see Tables 10 and 11). This 
was not true» however » of their basal reader curricula contemporaries. 
Fifty percent of the average ability females In this group changed 
from being considered "nonmasters" In the spring to "masters" In the 
fall (see Table 13). This was the largest change on any of the speci- 
fic skill tests. 

The change score pattern for subjects, as Illustrated on the 
histogram, found most scores unchanged between spring and fall (see 
Figure 14, p. 66). The changes that did take place were found pri- 
marily between the -1 and 4-2 categories. 
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FREQUENCY DISTRIBUTION OF WTRSD- 
POSSESSIVES TEST SCORES 
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CHAPTER IV 



DISCUSSION, CONCLUSIONS, AND SUMMARY 

In this chapter, each hypothesis is discussed In terms of the 
results presented In Chapter III. Conclusions, pedagogical linpllca» 
tlons, and a sununary of the study are provided. 

Discussion 

Hypothesis 1: There will be no significant difference between spring 
and fall Gates-MacGinltie Reading Teat or Wisconsin 
Tests of Reading Skill Development reading scores. 

Examination of the data presented in Table 6 indicates statis- 
tically significant losses on both measures of overall reading ability 
(Vocabulary and Comprehension) and on nine of the twelve tests mea- 
suring specific reading skills. The losses were significant at the 
.0001 level for eight measures, the .001 level for two measures, and 
the .01 level for one measure. Slight golns were found on only two of 
tlie remaining three tests. The galntj were not significant, however. 

It is interesting to note that the three tests on which no sig- 
nificant losses occurred were all measures assessing structural analysis 
reading skills. Six of the tests on which significant losses did occur 
measured phonic skills. One reason for the loss of reading skills may 
be related to the high degree of auditory discrimination ability required 
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of the subjects on phonic tests that require precise auditory acuity. 
It may be that the ability to discriminate, say, likenesses and differ- 
ences In sounds Is a highly sophisticated ability that Is not maintained 
over the summer vacation period. If this Is so, teachers may need to 
spend a specific amount of Instructional time with children practicing 
the discrimination of sounds before any type of fall testing programs 
requiring this skill Is undertaken. 

If auditory discrimination ability was an Important variable rela- 
ted to retention of scores, on the other hand, one Is hard pressed to 
explain why the losses should occur on the Vocabulary and Comprehension 
tests as well as the Sight Vocabulary, Compound Words, and Contractions 
tests. None of these measures required a high degree of auditory dis- 
crimination In order for a subject to perform well. It appears, then, 
that further Investigations Into this area are needed before any ade- 
quate answers will be forthcoming. 

It Is Important to examine Hypothesis 1 In terms of the practical 
application the findings have for the classroom teacher. The results of 
this study Indicate that the scores on norm-referenced, standardized 
reading tests change markedly for some children, between the spring and 
the fall. It Is interesting to speculate whether this change would exist 
after the pupils would have been in school for, say, one or two monthH 
Instead of only two weeks. From the data presented in this investiga- 
tion, it seems that teachers interested in measuring fall-spring reading 
achievement, utilizing standardized reading tests, should be aware of 
the fact that tests administered within two weeks after school resumes 
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in the fall might not be representing accurately the actual achievement 
of pupils* 

Another Issue pertaining to accuracy of scores relates to the con- 
fidence In test scores teachers can have for subjects who were admini- 
stered criterion-referenced reading tests In the spring and considered 
to have mastered specific reading skills. Will they continue to demon- 
strate mastery In the fall of the year Immediately following the summer 
vacation period? 

On the whole, between nine and fourteen percent of the subjects en- 
rolled In the objective-based curriculum and between nine and nineteen 
percent of the subjects enrolled In the basal reader curricula needed to 
be reclassified In the fall of the school year* It appears as If above- 
average IQ females tend to score the most consistently In terms of 
maintaining "mastery" scores, regardless of whether they have been 
enrolled In objective-based or basal reader reading curricula. 

One other finding related to this hypothesis deserves further 
mention. The data presented here seem to bear out Elder's (1923) 
earlier finding that the range of scores In the fall of the year Is 
greater than In the spring. The ranges of both the Vocabulary and 
Comprehension scores on the Gates-MacGlnltle Reading Test were greater 
in the fall than In the spring. The Increase In the range of scores 
was also evidenced by the criterion-referenced measures, although the 
Increase was not as great as It was for the norm- referenced test. 

Hypothesis 2: There will be no significant difference In retention 
ability between males and females* 

ERLC 
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The hypothesis that there would be no significant difference in 
retention ability between males and females was accepted unequivocally. 
There were no significant differences In retention ability between sexes 
on either the norm-referenced or the criterion-referenced tests. Evidently, 
while females may be better readers than males, at least in the United 
States (Johnson, 1972), they do not seem to be better at retaining 
either overall reading ability or specific reading skills over the sum- 
mer vacation period. 

Again, from a pedagogical point of view, it is Important to con- 
sider whether more males or females need to be reclassified as "masters" 
or "nonmasters" In the fall of the year. The data indicate no consistent 
change patterns favoring either sex (see Tables 10-13). Even while there 
may be a slight trend for females to be less prone to be recategorlzed 
as "nonmasters," the difference between the sexes amounts to less than 
five percent in favor of the females. 

Hypothesis 3: There will be no significant difference in retention 

between subjects of above- aver age, average, and below- 
average mental ability. 

Hypothesis 3 was also accepted, but with two qualifications. First, 
with the exception of average IQ subjects losing a significant degree 
(Rhyming Elements, p»<.01; Consonant Digraphs, pa<.05) more than their 
more and less intelligent contemporaries, there were no significant dif- 
ferences in ability to retain Information between groups (see Table 7). 
Or, to state it another way, there were no significant differences In 
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retention ability between the three IQ groups on forty of the forty-two 
comparisons. Moreover, the percentage of subjects needing to be recate- 
gorlzed as "masters" or "nonmasters" was similar for all IQ groups (see 
Tables 10-13). 

Hypothesis 4: There will be no significant difference In retention 
ability of subjects enrolled In the objective-based 
reading skills program versus subjects enrolled In 
the basal reader curricula. 

There was no statistically significant difference between the 
retention of scores for subjects in the objective-based curriculum ver- 
sus those enrolled it spiral-curricula; therefore. Hypothesis 4 was accepted 
(see Table 7). While there was a slight increase in the mean fall score on 
the Base Words test for objective-based curriculum subjects » losses were 
found on the thirteen other measures. Gains were found on three of the 
tests (Base Words, Plurals, and Possessives) for the basal reader group. 
One reason for basal reader curricula subjects performing slightly better 
than theii objective-based curriculum contemporaries may be related to 
the content found in the two curriculas. If, for example, the skills 
sequence of the basal readers emphasized structural analysis skills, such 
as plurals and possessives, one would expect better performance by chil- 
dren who had received instruction in this area. One other plausable 
explanation for objective-based curriculum subjects performing less well 
on the structural analysis skills may be, in part at least, due to their 
order of listing in the Wisconsin Design for Reading Skill Development 
continuum. Since the structural analysis skills arc the final five 
skills at Level B, it is conceivable that teachers iiHlng the objective 
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based program relegated the teaching of these skills to a subordinate 
status and emphasized the teaching of sight vocabulary and phonic skills 
Instead. If this was the .case, one might expect the objective-based sub- 
jects to be Inferior In the retention of these skills, since they probably 
would have had less opportunity to practice the skill during the academic 
year. 

Conclusions 

Four conclusions seem warranted on the basis of the results of 
this study. The conclusions have Implications for both researchers and 
classroom teachers. 

First, there Is a significant loss In both overall reading ability 
scores and specific criterion-referenced reading test scores between the 
spring and fall of the year. The loss, however, should be examined In 
light of pedagogical as well as statistical significance. At first, one 
might be tempted to conclude that all subjects using criterion-referenced 
reading programs need to be retested on a yearly basis If these programs 
are to be Implemented effectively. Such a testing program conducted each 
fall would Insure that pupil read ig skill records were current and accu- 
rate. Classroom teachers using these reading programs, however, are 
usually not concerned with statistical tests of significance and mean 
I cores of subjp^ts. Instead, they must deal with the operational effec- 
tiveness of reading programs on n day-to-day basis. What answers might 
thlH study provide Lhen'^ PerhapH moat Importnnt la the fact that a rela- 
tively minor number of subjecrtn move from the •'maMtory" catoRoiy in the 
spring to the '•nonmastery*' category in the fall. Cenerally, only around 
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fifteen percent of all the subjects tested In this study failed to re- 
main classified as "masters" In the fall. In an average classroom of 
thirty stu^-'o.nts, this would mean that only about four or five students 
would need to be retesteu aach fall. 

Readers are also reminded that the subjects In this study 
were relatively young, and probably, since most were only In the begin- 
ning stages of learning to read, did not have opportunities for extensive 
practice in applying the reading skills as, say, a nine- or ten-year-old 
might have. Perhaps this lack of practice could contribute to the change 
in ability over the summer. Such claims are only speculative, however, 
and remain to be tested in other studies. 

The results of this study do seem to indicate, then, that some 
subjects will need to be retested each fall. The number is not great, 
however. Certainly, it should be of some comfort to learn that fifty 
percent or more of the subjects do not need to be retested every year. 
Such an outcome might make a criterion-referenced reading program pro- 
hibitively expensive and pragmatically unmanageable. 

The second conclusion reached, based on the results of this study, 
is that the ability .to retain reading skills, as measured by both norm- 
referenced and criterion-referenced tests, does not differ significantly 
between first-grade males and females. While teachers are sometimes 
quick to suggest that the females in their classes appear to bf. better 
readers, the evidence obtained from this study suggests that they are 
not superior in ability to retain the skill of knowing how to read. 
The need, then, to test only boys in the fall of the year, does not seem 
warranted. 
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The third conclusion relates to how the intelligence of a subject 
(as measured by a standardized intelligence test) influences the ability 
to retain Information. This investigation revealed that subjects of 
below-average intelligence did not differ significantly from their more 
intellectually able peers. A note of caution, however, needs to be 
stressed here. The size of the below-average IQ group In this study 
was small. It could well be that more subjects in this group would 
have influenced the results. Future Investigations might want to focus 
specifically on this below-average IQ group when measuring retention 
of reading skills. 

Finally, while It might be expected that subjects who were 
enrolled In the criterion-referenced curriculum would be more apt to 
retain the specific reading skills, when compared with their basal 
reader curricula peers, this was not the case. The basal reader 
curricula subjects, In fact, had lower change scores on eight of the 
fourteen measures. Evidently, the one year enrollment in the criterion- 
referenced program had little effect on the ability to maintain their 
previous spring scores. 

In conclusion, there appear to be significant losses in read- 
ing ability when mean spring and fall reading test scores are sub- 
jected to the analysis of variance treatment. When the data are analyzed 
descriptively, however, there Is only a minor change In the percentage 
of subjects considered "masters" of the specific skills in the spring 
to "nonmasters" in the fall. About fifteen percent of the first graders 
in this study changed from the "mastery" to the "nonmastery" category 
between the spring and fall. Sex of subject, Intellectual ability, and 
type of school reading curriculum had little bearing on the ability to 
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retain either overall reading ability, as measured by t'ne Gates- 
MacGlnltle Reading Test , or specific reading skills, as measured by the 
Wisconsin Tests of Reading Skill Development-Word Attack . Level B. 

Summary 

This study was designed to assess the effect the summer vacation 
period has on the reading ability of first-grade subjects, as measured 
by norm- and criterion-referenced reading tests. The data were analyzed 
to determlr.e If sex of subject, IQ, or type of school reading curriculum 
were related to the ability to retain overall reading ability or specific 
reading skills. 

Method 

Subjects In the study were 311 first-grade pupils enrolled In 
nine northeastern Wisconsin elementary tjiools. Approximately one-half 
of the subjects were enrolled In an objective-based reading program 
while the remaining subjects were enrolled In basal reader curricula. 

All subjects were administered the Gates-'MacGlnltle Reading Test > 
Primary A, and the 'Wisconsin Tests of Reading Skill Development -^Word 
Attack , Level 6, two weeks prior to and two weeks after the summer vaca- 
tion period. In addition, the California Short-Form Test of Mental 
Maturity was administered to all subjects during the spring testing ses- 
slons. Subjects with IQ scores which fell within the third or seventh 
stanlnes were not Included In the data analysis. A multiple analysis 
of variance statistical treatment was used to annly/c the dnta. Reten- 
tion of reading scores between the spring and fall was th« dependent 
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variable; sex of subject, Intelligence, and type of school readxng curri- 
culum were the Independent variables. 

Conclusions and Implications 

Statistically significant differences were found between the mean 
spring and fall test scores on eleven of the fourteen measures. Sex of sub 
ject and type of school reading curriculum were not significantly related 
to ability to retain reading skills. Intelligence of subjects was found 
to be related to retention ability on only two of the measures. 

Fifteen percent of the subjects changed from being considered "mas- 
ters" of the specific reading skills In the spring to being classified as 
"nonmasters" in the fall. Achieving a score of eighty percent or better 
on any of the specific skill tests was the criterion for mastery. 

It was concluded that even though statistically significant losses 
occurred on most of the tests, the most meaningful measure of change was 
the difference between the percentage of subjects considered to have mas- 
tered the skills In the spring versus the percentage In the fall. The 
fifteen percent change between the two times was not considered great 
enough to suggest massive schoolwlde retestlng of all subjects In cri- 
terion-referenced reading programs. Instead, retestlng of subjects might 
be done on the basis of teacher subjective judgment, thereby reducing 
considerably, the cost and time necessary to implement such a reading 
program. 

In concluHion than, hgx of .subject, Inl c I led ii.il .•ihlllly, ,infl f ypf 
of school reading currlcultjni do not appear to he Importnnl varl/ihlcH rd.i- 
ted to the retention of overall reading ability and .specific rcfifllng .skillH 
While significant losses vere found on eleven of the fourteen meaKuras, 



when the data were examined In terms of percentage of subjects considered 
to have mastered the skills In the spring and fall, only fifteen percent 
of the subjects needed to be recategorlzed. 
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